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PHN 16.435 EP-P 
Input device. 



The invention relates to a method for controlling graphics on a display 
through manipulation of an input device, the method comprising: 

a measuring step measuring a plurality of components of a magnetic field 
related to an orientation of the input device, and 

a control step controlling the graphics on the basis of the plurality of 
components. 

The invention further relates to an input device for controlling graphics on 
a display, the input device comprising: 

a plurality of sensors for measuring respective components of a magnetic field 
related to an orientation of the input device, and 

a controller for controlling the graphics on the basis of the plurality of 
components. 

Such a method and input device are described in United States Patent 
5,394,028. According to the known method, the orientation of an input device is 
determined by measuring the magnetic field at the position of the input device. This 
magnetic field may be the earth's geomagnetic field or a local magnetic field. The input 
device has three mutually orthogonal groups of Hall sensors, one for each direction of 
the magnetic field. The output of each of the groups is amplified and after an analogue 
to digital conversion sent to a computer as three separate signals. Each of the three 
signals represents a respective component of the magnetic field and the signals represent 
respectively the pitch, the roll and the yaw of the input device. The known system 
controls computer graphics on a display in accordance with the pitch, roll and yaw 
signals from the input device. 

It is an object of the invention to provide a method of the kind set forth 
which improves the control of the graphics on the display. This object is achieved 
according to the invention in a method that is characterised in that the control step 
includes a calculation step calculating a first signal on the basis of at least two of the 
plurality of components, the first signal controlling translation movement of an indicator 
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in a first direction on the display. In this way, the method can be applied in moving an 
indicator to a particular position on the display and, through that action, pointing to a 
particular object among a number of objects on the display. The movements of the input 
device control the movements of the indicator on the display. Pointing to an object may 
5 be followed by some confirmation step, selecting the particular object from among the 
number of objects. The indicator may be a cursor, like an arrow, for pointing to a 
button on a menu of buttons representing tasks or information items in an application 
program. The moving indicator may also be implemented as a moving highlight or other 
indicative measure along a row of selectable objects. 
*0 It is known as such to control the position of a cursor on a display 

through determining the orientation of an input device. United States Patent 5,440,326 
describes an input device equipped with a gyroscope to sense changes in the orientation 
of the device. Through these changes a cursor on a computer display is controlled. The 
gyroscope is driven by a motor requiring a relatively large amount of power. The 
15 gyroscope is complicated to manufacture and is relatively expensive. Furthermore, the 
input device with the gyroscope experiences an intrinsic, continuous drift, resulting in a 
movement of the cursor on the display while the input device is held still. The input 
device according to the invention is very different from the known input device of the 
reference in that it is based on a different principle of sensing its orientation. The 
20 orientation of the device according to the invention is determined by measuring the 

magnetic field around the input device. This avoids the above mentioned drawbacks: the 
device requires a small amount of power, is easier to manufacture and experiences no 
drift. Furthermore, the size of the input device according to the invention can be very 
small compared to the known device. 
25 An embodiment of the method according to the invention is defined in 

Claim 2. By calculating a second signal for controlling the indicator in a second 
direction on the display, full control of the indicator on the display is possible. 

An embodiment of the method according to the invention is defined in 
Claim 3. The initialisation step provides a reference orientation for the input device. 
30 Subsequent changes in the orientation of the input device are calculated with respect to 
this reference position. Such a reference orientation can for example be the orientation 
of the input device while the user points towards the centre of the display. The actual 
trigger for executing the initialisation step can be chosen from various possibilities. This 



PHN 16.435 EP-P 3 

could be when the device is activated, e.g. switched on or lifted from a resting place, 
thus immediately providing a reference position. Additionally, or alternatively, the 
initialisation step could be executed at the request of the user, e.g. through pressing a 
button arranged for this purpose. Also the execution of the initialisation step could be 
5 triggered by an external event, e.g. a sudden disturbance in the magnetic field. 

An embodiment of the method according to the invention is defined in 
Claim 5. Such generated field can be designed to be stronger than the permanent 
geomagnetic field. The orientation of the input device can then be detected in a more 
reliable manner, which is less susceptible to disturbances. 
10 11 is a further object of the invention to provide an input device of the 

kind set forth which allows improved control of the graphics compared to the known 
input device. This object is achieved according to the invention in an input device which 
is characterised in that the controller includes calculation means for calculating a first 
signal on the basis of data from at least two of the plurality of sensors, the first signal 
15 controlling translation movement of an indicator in a first direction on the display. The 
input device according to the invention provides the control of an indicator on the 
display. This can be used for pointing and selecting objects from among a plurality of 
objects on the display. Furthermore, the input device according to the invention is less 
sensitive to disturbances than the known input device because it combines data from two 
20 components of the magnetic field into one control signal. A disturbance in a first one of 
the components will not be fully passed on to the control signal but will be mitigated by 
the second one of the components. 

An embodiment of the input device according to the invention is defined 
in Claim 8. Through the reset means a reference orientation of the input device may be 

25 determined. The control signal for the indicator is based on the comparison between a 
subsequent orientation of the input device and the reference orientation. The reset means 
may be activated through a dedicated reset button on the device or through a switch that 
is switched on when the input device is lifted from its rest position. An example is 
where the user of the input apparatus operates the reset button while pointing towards 

30 the centre of the display, thus making that orientation the reference orientation. When 
the user subsequently points away from the centre, the indicator on the display will 
move away from the centre in the same direction as the input device. Additionally, or 
alternatively to activating the reset means through a reset button or a switch, the reset 
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means may be activated when a disturbance in the magnetic field is determined. In that 
way, the disturbance has no erroneous impact on the movement of the indicator and the 
input device is rendered operational again with a new reference orientation. 

An embodiment of the input device according to the invention is defined 
5 in Claim 9. An MR sensor is a sensitive and suitable sensor for measuring a small 
magnetic field. This is in particular advantageous if the geomagnetic field is employed 
in the input device. 

An embodiment of the graphical input system according to the invention is 
defined in Claim 10. An MR sensor is sensitive in the plane of the sensor. Two MR 
10 sensors can be arranged on a single, flat substrate for measuring the magnetic field in 
two directions in the plane of the substrate. A Hall sensor is sensitive for the magnetic 
field perpendicular to the plane of the sensor. The Hall sensor can be arranged on the 
same substrate as the two MR sensors for measuring the magnetic field in the direction 
perpendicular to the plane of the substrate. So each of the three sensor measures one of 
15 the three orthogonal directions of the magnetic field. In an embodiment, each of the 
sensors is manufactured separately and is subsequently attached to the common substrate 
at the desired position, e.g. as in a so-called MCM (Multi Chip Module). Later 
assembly of the input device only requires the single common substrate and does not 
require further assembly of different substrates into the input device. An alternative 
20 embodiment is where the three sensors are directly manufactured on the same common 
substrate, e.g. a silicon wafer. The advantages are that only a single manufacturing 
process is required and that the positioning and alignment of the sensors can easily be 
realised in that process. 

Further advantageous embodiments of the invention are recited in 
25 dependent claims. 

The invention and its attendant advantages will be further elucidated with 
the aid of exemplary embodiments and the accompanying schematic drawings, whereby: 

Figure 1 schematically shows the principle of operation of the input 
device according to the invention, 
30 Figure 2 shows the translation movement according to the invention of an 

indicator on the display, 

Figure 3 schematically shows an input device according to the invention, 

Figure 4 schematically shows an alternative embodiment of the input 
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device according to the invention, 

Figure 5 schematically shows an arrangement of the sensors of the input 
device on a single substrate, and 

Figure 6 shows an overview of the arrangement of the input device using 
5 a magnet for generating the magnetic field. 

Corresponding features in the various Figures are denoted by the same 
reference symbols. 

Figure 1 schematically shows the principle of operation of the input 
device according to the invention. The input device 100 is arranged to measure the three 

10 orthogonal components of magnetic field 102. This magnetic field may be the 

geomagnetic field of the earth or a local magnetic field, specifically generated by the 
input device. The input device comprises a sensor 104 for measuring the H x component 
106, a sensor 108 for measuring the H y component 110 and a sensor 112 for measuring 
the H z component 114. The sensors in Figure 1 are implemented as AMR (aniso tropical 

15 magnetoresistive) sensors by way of example. Other types of sensors are also feasible. 
The sensors produce a signal that is proportional to the respective measured component 
of the magnetic field. The value of the output signal for a given magnetic field depends 
on the construction of the sensor and may be different among the three sensors. An MR 
sensor is sensitive to a magnetic field in a particular direction in the plane of the sensor 

20 and produces a signal that is proportional to the magnetic field in that direction. The 
signal V x of sensor 104 is proportional to the strength of the H x component of the 
magnetic field, the signal V y of sensor 108 is proportional to the strength of the H y 
component of the magnetic field, and the signal V 2 of sensor 112 is proportional to the 
strength of the H 2 component of the magnetic field. The output signals will be further 

25 processed and used to control an indicator on the display of the system for which the 
input device is operative. When the orientation of the input device changes to a new 
position, the three sensors and the shown co-ordinate system will take a new position 
with respect to the magnetic field 102. In dependence on the change of orientation, the 
measured components will change, resulting in new output signals from which the new 

30 position can be calculated. If the magnetic field would be produced by a local magnet, 
the orientation of the magnetic field with respect to the input device may also be 
changed by changing the orientation of the local magnet. This will result in a similar 
way to new output signals obtained from the sensors. So in the case of a magnetic field 
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that is locally generated, as opposed to the magnetic field of the earth, there is a design 
choice for the input device for changing the orientation of the magnetic field with 
respect to the sensors. The part of the input device generating the magnetic field may be 
stationary and the part with the sensors freely movable, or the part with the sensors may 
5 be stationary and the part generating the field freely movable. 

The input device of Figure 1 provides three sensor output signals carrying 
the information on the orientation of the input device with respect to the magnetic field. 
According to the invention, these three sensor output signals are reduced to two signals 
for translation movement of an indicator on the display. A simple way of calculating the 
10 two signals is given in the following formulae: 



X = sin 



arctan— 



vl 



(i) 



Y = sin 



( V z^ 

I arctan — - 



(2) 



15 

In this embodiment, an additional sine- function has been applied for obtaining the X- 
signal and the Y-signal. An alternative calculation would be to omit the sine-function. 
Furthermore, respective scale factors may be applied in the formulae in order to obtain 
an appropriate scale for the translation movement of the indicator on the display. 
20 In an alternative embodiment, the X-signal and the Y-signal are calculated 

with respect to a reference orientation of the input device. To this end, the input device 
is reset in the desired reference orientation and the respective output signals V x0 , V 0 
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and V z0 of the sensors are determined and stored for subsequent calculations. The X- 
signal and the Y-signal are then obtained according to the following formulae: 



x - v " v > - v y° v * (3) 



2 
yO 



Y = x0 z z0 x (4) 



2 , 7 2 
xO + V z0 



In cases where the overall strength of the magnetic field is substantially the same for 
different positions of the input device, e.g. in the case of the geomagnetic field, the 
10 formulae (3) and (4) can be reduced to: 



x = _xO^ yOx (5) 

v 2 x + vj 



v _ V xO V z V zO V x • ,~ 

" 2 2 (6) 

V + V 

x z 

15 

Figure 2 shows the translation movement according to the invention of an 
indicator on the display. On a display 202 and indicator 204 is displayed. This indicator 
may be implemented as cursor, e.g. in the form of an arrow, cross or other symbol. 
However the cursor may also be implemented as some highlight moving across objects 
20 on the display, whereby the particular object is highlighted which is being pointed to. 
The indicator 204 is moved in the horizontal direction 206 in response to the X-signal 
208 and is moved in the vertical direction 210 in response to the Y-signal 212. The 
actual movement in a certain direction in response to the respective signal may be 
implemented in different ways. It is possible that the indicator assumes a position along 



# 
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that direction in direct proportion to the signal. When the signal is zero, the indicator is 
at its reference position, e.g. the centre of the display, and when the signal has a certain 
value the indicator assumes a position corresponding to that value and remains there as 
long as the signal has that value. In this implementation, the indicator follows the 
5 movements of the input device in a direct correspondence. An alternative 

implementation is where the value of the signal is used as a switch activating the 
movement of the indicator. As long as the value of the signal is zero, the indicator 
remains at its latest position along the respective direction. When the signal has a 
certain value it moves with a certain speed, e.g. in proportion to the value of the signal, 

10 and does so until the signal value changes. In this implementation the input device 
operates similar to an accelerator pedal and the actual position of the indicator has no 
correspondence to the actual signal value. 

The input device according to the invention may have a reset function 
providing a new reference orientation for moving the indicator. Resetting the input 

15 device may involve two separate actions. The output values corresponding to the 
orientation at the moment of the reset are determined and stored for subsequent 
measurements. These values are then used as an offset values in the subsequent 
calculations. Furthermore, resetting the input device may move the cursor to a 
predetermined reference position, for example the centre of the display, the upper left 

20 corner of the display or at the first object of a row of objects on the display. In order to 
execute the reset function, the input device may be provided with a dedicated reset 
button to be operated by the user of the device. When the user holds the input device 
with a suitable orientation, he may operate the reset function and in that way defining 
this suitable orientation as the reference orientation. The reset function may also be 

25 executed when the input device is activated. This can be realised as a switch which is 
activated when the user lifts the input device from its rest position. The reset function 
may also be executed automatically in case of a disturbance resulting in a relative large 
change in the overall strength of the magnetic field. The input device of that 
embodiment monitors the strength of the magnetic field and when this differs too much 

30 from the reference values, the reset function is executed again. To this end, it is 
determined whether one of the following conditions is fulfilled: 



# 
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V l + Vy + > 0+5) . (V& + V$> + V zo) (7) 



^ + v y + v z < (1-5) • + ^ + v£) (8) 



5 In these formulae, the symbol 5 defines a threshold for the allowable variation in the 
strength of the magnetic field. 

In the example in Figures 1 and 2, the two components of the magnetic 
field from which the signal for controlling the indicator are calculated, are orthogonal 
components. This is not necessary for application of the invention and the two 

10 components may have a different mutual angle. It is a sufficient condition that the two 
component are not dependent to each other, i.e. that they do not completely extend in 
the same direction. The combination of two components into a single signal controlling 
the translation movement of the indicator makes the signal less dependent on 
disturbances in the magnetic field. An error in one the components, due to a 

15 disturbance, is not fully passed on to the signal but its effect is mitigated due the other 
component. This can also be seen from the various formulae for calculating the X-signal 
or the Y-signal, e.g. formulae (1) and (2) 

Figure 3 schematically shows an input device according to the invention. 
A freely movable handheld part 302 comprises the sensors 104, 108 and 112 and a 

20 controller 304 controlling the indicator on the basis of output signals of the sensors. The 
input device further comprises calculation means 306 for calculating the X-signal and 
the Y-signal and reset means 308 for resetting the input device to a reference 
orientation. The reset means are operated through a switch 310 which may be 
implemented as a user operable push button or as part of an activation switch activating 

25 the device. The device further comprises a storage 312 for storing the output signals of 
the sensors at the time of a reset, for later use as reference values. The calculated X- 
signal and Y-signal are transmitted from the handheld part through a transmitter 314 to 
the stationary part 316 near a display 318 on which the indicator is to be moved. In the 
stationary part 316, the signals are received in a receiver 320 and are transferred to the 

30 display via interface 322. The transmitter 314 and receiver 320 may be implemented as 
an infrared sending/receiving device or as a radio-frequency sending/receiving device. 
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Alternatively, the movable part 302 may be connected via a wire to the stationary thus 
avoiding the need for a transmitter and a receiver. However, this will limit the 
movements of the handheld part 302 to a certain extent. In the example shown in Figure 
3, most of the elements of the input device reside in the freely movable handheld part 
5 302 and this part transmits the X-signal, the Y-signal and a command for moving the 
cursor to the reference position. 

Figure 4 schematically shows an alternative embodiment of the input 
device according to the invention. In this embodiment, the handheld part 302 comprises 
the sensors 104, 108 and 112, the reset switch 310 and the transmitter 314. The other 

10 elements now reside in the stationary part 316 of the input device. The handheld part 
transmits the sensor output signals V x , V y and V z and, if applicable, the fact that the 
reset switch has been activated to the stationary part. 

Figure 5 schematically shows an arrangement of the sensors of the input 
device on a single substrate. The input device comprises a substrate 502, for instance of 

15 silicon, on which 3 sensors have been assembled. Sensor 504 is an MR sensor which 
has been made sensitive for measuring a magnetic field in direction 506 and sensor 508 
is a also an MR sensor, but this one is made sensitive for measuring a field in direction 
510. Sensor 512 is a Hall sensor which is sensitive in direction 514, perpendicular to 
the substrate. So the three sensors can each measure an orthogonal component of the 

20 magnetic field through the substrate and can therefore be used as the sensors in the 
input device according to the invention. It is advantageous to manufacture the three 
sensors on a single substrate because in this way they can be realised in a single 
manufacturing step. There is no need to later assemble different substrates, each 
carrying one or two sensors, together for the manufacture of the input device. The 

25 substrate 502 can further comprise the sensor connection wires and additional circuitry 
516, implementing the required elements like the controller 304, the calculation means 
306, the reset means 308," the storage 312 and the transmitter 314. This further eases 
the manufacturing process of the input device and reduces the production costs. 

Figure 6 shows an overview of the arrangement of the input device using 

30 a magnet for generating the magnetic field. A magnet 602, this may be either a 
/ permanent magnet or an electromagnet generates a magnet field 604. The movable part 
302 of the input device has a certain orientation with respect to the magnetic field, 
resulting in specific values measured by the three sensors. The movable part 302 
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transmits its signals to the stationary part 316 which delivers the control signal to 
display 318 for moving the indicator. In an embodiment of the input device according to 
the invention, the magnet is realised as a bracelet on the wrist of the user and the 
movable part 302 as a ring on a finger of the corresponding hand. The indicator on the 
display is controlled by simple movements of that finger because the orientation of the 
movable part 302 then changes with respect to the magnetic field in correspondence 
with the movements. The function of the bracelet and the ring could simply be 
interchanged, resulting in the arrangement in which the ring includes a magnet and the 
bracelet includes the sensor sensing changes of the magnet field. Also in this 
arrangement, the indicator is controlled through movements of the finger with ring 
relative to the wrist with the bracelet. 

In an alternative embodiment, the magnet 602 is arranged in the stationary 
part 316, thus forming a single stationary part of the input device. In this embodiment, 
the input device according to the invention still comprises only two part despite the fact 
that a magnet is used for generating the magnetic field. 
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CLAIMS: 



1 . A method for controlling graphics on a display through manipulation of an 

input device, the method comprising: 

a measuring step measuring a plurality of components of a magnetic field 
related to an orientation of the input device, and 
5 a control step controlling the graphics on the basis of the plurality of 

components, 

characterised in that the control step includes a calculation step calculating a first signal 
on the basis of at least two of the plurality of components, the first signal controlling 
translation movement of an indicator in a first direction on the display. 

10 2. A method as claimed in Claim 1, wherein the calculation step further 

includes calculating a second signal on the basis of at least two of the plurality of 
components, at least one of the at least two being different from the at least two 
components for calculating the first signal, the second signal controlling translation 
movement of the indicator in a second direction on the display. 

15 3. A method as claimed in Claim 1, wherein the control step includes an 

initialisation step measuring reference values of the plurality of components with respect 
to the orientation of the input device at the instant of executing the initialisation step, 
and wherein the calculating step calculates the first signal on the basis of a difference 
between current values and reference values of respective ones of the at least two of the 

20 plurality of components. 

4. A method as claimed in Claim 3, wherein the measuring step measures 
three components of the magnetic field thus measuring the strength of the magnetic 
field, and wherein the initialisation step is executed if the difference in strength between 
two successive executions of the measuring step is larger than a predetermined 

25 threshold. 

5. A method as claimed in Claim 1, wherein the magnetic field is generated 
by a permanent magnet or an electromagnet. 

6. An input device for controlling graphics on a display, the input device 
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comprising: 

a plurality of sensors for measuring respective components of a magnetic field 
related to an orientation of the input device, and 

a controller for controlling the graphics on the basis of the plurality of 
5 components, 

characterised in that the controller includes calculation means for calculating a first 
signal on the basis of data from at least two of the plurality of sensors, the first signal 
controlling translation movement of an indicator in a first direction on the display. 

7. An input device as claimed in Claim 6, wherein the calculation means are 
10 further arranged for calculating a second signal on the basis of data from at least two of 

the plurality of sensors, at least one of the at least two being different from the at least 
two sensors for calculating the first signal, the second signal controlling translation 
movement of the indicator in a second direction on the display. 

8. An input device as claimed in Claim 6, further comprising reset means for 
15 measuring reference data of the plurality of sensors with respect to the orientation of the 

input device, and wherein the calculating means are arranged for calculating the first 
signal on the basis of a difference between current data and the reference data of 
respective ones of the at least two of the plurality of sensors. 

9. An input device as claimed in Claim 6, wherein at least one of the 
20 plurality of sensors is an MR (magnetoresistive) sensor. 

10. An input device as claimed in Claim 6, wherein two of the plurality of 
sensors comprise an MR sensor and wherein a third of the plurality of sensors 
comprises a Hall sensor, the three sensors being manufactured on a single substrate. 
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ABSTRACT : 
Input device. 



An input device (302,316) comprises a plurality of magnetic sensors 
(104,108,112) for measuring the components (106,110,114) of a magnetic field (102) at 
the position of the input device (302). The magnetic field may be the geomagnetic field 
of the earth or a magnetic field generated by a local magnet (602). The data of at least 
two (104,108) of the sensors are used for calculating a first signal (208) for controlling 
the translation movement of an indicator (204) on a display (202). 
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